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Score on the Mathematics Test of the National Teacher Examinations : * 


(NTE) was the dependent variable in a stepwise multiple regression using 


’ 
. 


personological variables of in-service teachers as regressors. -Two vari-, . “ 
. ables--number of semester hours' credit in mathematics, and gradé level of 
teaching--accounted. for 61 percent of the observed NTE score variance. 


t i ‘ o 
' Predicted and obtained NTE scores were compared for a trichotomous division a 


of teachers into low, middle, and high achievement. The prediction seems ..‘_ 


- 


adequate for use in classifying teachers by achievement in research studies 


without requiring costly and time-consuming testing. oe . 
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approximately 150-five-alternative multiple choise items and require two hours ~ 


we ft ea ! 
INTRODUCTION 
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“The National Teacher Examinations ; (NTE) have been prepared and admin- 
; : a _ : a 
istered by the Educational Testing’ Service (ETS) since 1950. The NTE consists ‘ 
of a battery of paper-and-pencil tests designed, to.measure knowledge and cog- 


mative sata in three eal exese of teacher preparation: general educa- 
{ 


a 


tion, professional education, and dublactstigtt specialization. The NTE 


consists of a battery of Common Examinations designed to measure general 


teaching competencies ae individual teaching area examinations. : The latter: 


were originally written and are revised each year oy panels of experts se- 


U 
‘ 


lected from achoole, colleges, and vats programs. , The tests consist of 


’ 


to administer. The revision and replacement of certain items each year permit 


updating of the examinations while also permitting the scaling of raw. scores. 
against previous years’ tests to obtain group norms (see Buros, 1972). 
NTE scores are often used as selection criteria for teacher, placement. 
. . es ? . 


Quick, Witten, and Weinberg (1973) reviewed the extensive literature sur- 
rounding the NTE on validity and relationships with teaching variables. A 


° \ 4 
potential use of NTE scores, not discussed by them or. others is as a measure 


° : 


of teacher achievement or ability in educational: research studies. Since the 


NTE is secure and costly to administer for many research purposes, a predic- 


_tion’of a teacher’s NTE scores from various easily obtained teacher variables 


would.be useful. Such scores would provide a basis for classification of 


teachers for ANOVA, ANCOVA, or multiple regression, commonly used in educa- 


e- % 


tional research. In this paper, a prediction equation for NTE Mathematics 


test scores is proviiled. 
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Recently, Games (1975) has questioned the use of unreliable variables - 
‘ i . 
for classification in factorial designs. He suggests that the effects for 


such factors are-uninterpretable. We tend to agree in cases of nonorthogo- 
, ’ 


nality or for other complex situations. The basic fact of partitioning Co 


< variance into explained and unexplained (error) components is unchanged, 
: ; 


however. Where a classification variable aids in this, it will help to in- 


‘ ‘crease power for the other factors, even if the classification variable is 
s : aa 
, ignored. o , ~~ * 
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_ Sample 
In.1971, the Minnesota Research and Evaluation Project (MREP) collected 
data of junior and senior high school mathematics teachers using a systematic 
danpdime pian for schools with stratification on petarad Sendeeaphie yariables. ~ 
Teachers within schools waive nandonty selected (see Gullickson and Welch, 
1972) As part of the data collection, 127 teachers were given the NTE Mathe- 
atten dein siion. A: second wenn ® as. “dean in 1976. It included some 
‘ , 


teachers sampled in 1971 and a new set, which provides a sample for cross- 


validation. 


Variables in the Analysis 
Coees NIE math scores ranged from 385 to 800 (approximately thegist 
to 99th pércentites from the ETS 1971 norm tables) for the 1971 sample of 
. , teachers. The mean score for. the teachers was 644 with a standard deviation 
of 121. The NTE national norm mean and standard deviation are 639 and 83.5 


for college seniors, the norm: group. ote 
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Seven predicters were entered in the-regression' analysis. ‘These variables 


* 


-are all easily measured by pencil and paper responses of teacliers: (1) the , an 
* number “of sewester hours' college-level mathematics ea: each teacher had taken 


- (both gina Sabie and graduate) ; (2) number of saueheed mathematics eoukees 


taught (algebra, geometry, and analytics,- ses ” sedans grade level of 


teachings, (4) number of years eines the, teaching devraa was “obtained; (5) num- 


ber ‘of semester hours' work in eathemaeten since the last degree obtained; 


(6) number of years teaching ourtench and (7) number of semester hours' 
as sae : 
coursework in science. 9 
u az 1 - soy 
The régression analysis used was a forward ‘stepwise multiple regression. 
; : 


The predictor correlating RighesE #ith NTE score “4a entered first. ne resid- | 


* 


uals of this regression are correlated with the remaining predictors snd the 


‘most eee ROREEIStE? of ae is selected. A new regression: equation “is od Es 


constructed with the two predictors, and so on, At each entry all regression 
variables are tested as if they were the Vast included (F-test for inclysion). 


The overall vardance of ‘the regression equation (onetall regression F-test) 


is also examined. The regression program used was from the Stathetteat 


~Package fsx the ‘Social Sciences (1974), bee pairwise deletion fae missing 


data, which competond less than 12% for six of the seven independent variables. 
Results 
Using the criterion Draper and Smith (1966) suggest that the overall ® 
regression F-value be four times the critical value, and our own criteria 
that the variables be meaningful and significant at p @ .01, two warpabies 


were found to predict NTE mathematics scores. Variables (1), total semester ' 


> = 4 : 4 * J , % . F 
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hours' work in mathematics, and (3), grade level of teaching, accounted for - 


61 percent of the variance \(R2 =", 611) of NIE scores. The wording ‘of thése 
. . . tao a 


in Table 1. | 
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questions, the regression table, and-the final equation are given 


o : .Y Cc ? 
’ Table 1:, Variable List and Regression ; . 
Table for NTE Mathematics Prediction Study Sy 
i : 
Variable List . 


9 ? . 
fr 


. si o w 48. wt 
Varjable 1: "Please indicate the number of undergraduate’ and graduate hours 
' you have taken in mathematics." (Multiply quarter hours by 2/3. 
to get semester hours. ) : : . . 


a r ’ . i oa agg 


F Mathematics 7 % 


Variable 3: Grade level of students in the majority of the classes you , 
< teach. (Paraphrased from the original set of questions.) : 


= 


al 4:8 Regression Table : 
‘ - ‘. ; : ' @ > 
- Variable fF to Enter Probability Total R2 b-weight « Overall F Prob 
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: 55.6 - <.01 , 54 3.497 55-6 401 
1 ae ; 
- df = 1.47. "df = 1,119 
8.2 <.01 61 2°~—si23,99 36 SL 
3 4 wm Pod . ’ 
df = 2.46 : df = 2.46 
' : / s * U Al © a. * + a. 
Constant seas i me , mee 413.09 --- _— +; 
e a ~~ es te \e ¢ 
ANY a 
. a ‘ s - 
eek % i ; * 


Prediction and Cross-Validation 


z ; bs 
o) 7 The prediction equation recommended for use by researchers is 


= . _ ° NTE ® 3.497 x @ credit hours math) + - 
« & Re 23.99 x (grade level of classes) + 
= "613.09 
‘s _ The utility of a simple prediction equation for. NTE Mathematics scores : : 


lies in quick classification of teachers into. ability sveupe sl research 


purposes. _ Either, covariation or use in a factorial design may be quickly ac- ° 
complished without recourse to costly and time-consuming testing. Of course, ~ 


“the Predictions are limited and are not entirely suitable for mare exacting 


requirements. P ; Z , 


' ¥ . ’ 


To examine the classificatory’ function of the regression equation, \ 


teachers in ne 1976" sample were grouped into top, middle, and low 33rd cen- 


wy 


tiles from the 1971 sample's observed are scores. Predicted NTE scores using) 


_ the. 1971 equation were computed for fs, eats with, _ ciaplete data on watlabies 


(1) and (3), a total of 66 scores. The eonttiiewacy table for predicted: VS. 


actual achievement grouping was constructed and is given in Table 2. Note , 
that misclassification is small between high and low achievement groups. 
1 Porter (1967) and Glass, Peckham, and Sanders (1972) discuss the problem of 


‘ fallible covariates, | At one is to use the predictions as a covariate. be 2 s 


ROGET BEAG of sipeantcben and ohenrved : scores is .67, while for the trinomial 
a 4 
sontiigeney table the contingency hick iii 1s, 65) which equal to 


Vx2/ GAN) , where x2 is the familiar chi-square statistic ob association. a 


Kendall's tan for the 3x3 table is .591; these coefficients indicate that the 


ee 


-in science. 


prediction is accurate in gross trinomial classification about 2/3 of the 


. "& 


"- time. Extreme misclassification (from actual Low to predicted High, and 


vice versa) occurred for only one case out of 66 in the “cross-validation. , , 
; nk = 


‘ 
a 


Table 2: Cross-Validation. Contingency Table of 
Actual and Predicted Achievement Grouping for . : 
NTE Mathematics Scores of 66 Teachers er st . a tues oe S 


Ie 


¥ 
Low Achievement ‘(Score less than 600): ~ 


Middle Achievement (Score between 600 and 675) 


ee High Achievement (Score above 675) - 


ad 


Predicted Grouping | 


‘Low Middle “High ; , 
Actual ! Ps 
Grouping sone 11 
Middle 15 | 
¢ : ; 
High 40 
: 66 


‘A similar ‘Kéuceenion was) performed for science teachers’ NTE scores 


_and a SERRE OT OEIOE ere percent of the variance was predicted. This 


sunkenrs Chae the differences ‘in tralntug, ability, and knowledge of junior 


and senior high teachers are more pronounced in secondary math teaching than 
. ia ; ; ‘ é 
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a Conclusion 


© 
- 


The prediction. equation presented in the paper may be used by researchers 


as a means to predict teacher mathemagics achievement on the NTE. Suggested 


use’ is for blocking or covarying to gain power in research studies. 
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